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Method and system for embedding extra information, method and system for decoding 



10 



The invention relates to a method of embedding extra information in an input 

signal. 

The invention further relates to a system for embedding extra information in 
an input signal. 

The invention further relates to a method of decoding extra infoimadon 
embedded in an input signaL 

The invention further relates to a system for decoding extra information 
embedded in an input signal. 



^, ^ ^ Digital Cinema Theatre, very high quality digital video material, typically 

192Qxl080» 30-bit RGB> is projected on a large screen. Because of the extremely high video 
quality, this material needs protection against unauthoirsed coping. A strai^tforward way ^ 
to obtain a cc^y of the projected video material is by simply udng a video camera. Today, 

IS content providers are facing the problem ttiat good quality lecofdings are being made in that 
vncy^ and that illegal copies of these recordings are being sold. 

To 0g^t this form of ^racy, it would help if the particular cinema theatre, as 
wdl as possibly tibe projection date and time, could be identified from the illegal leccmling. 
Preferably, this theatze information is embedded in a way such tfiat it is not obtnisive. such 

20 that it is not annoying to viewers, and such that it cannot be easily removed from the illegal 
reccn^ding. 

A straightforward method to prevent the above-described scenario would be 
the follovnng. At the time of projection, a unique number identi^ng the particular di£^tal 
cinema tfaeatre together with the time and date of projection are embedded into tiie video 
25 using some digital watermarking technology. This watermarking application, where usars get 
a unique watermark, is usually called '^fingerprinting". In this way, die illegal' recording vnW 
contain the same watermark. Using a digital watermark detector, the identifier numb^ can be 
retdeved from a copied tape and the "negligent^ * dieatre can be identified. 
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However, the demands on the video watennaridng technology are extremely 
high. The camcorder is likely not on axis to the projector and the screen is curved both 
horizontally and veitically. Hence, non-linear distortions will occur, making watermaiic 
detection very difficult. Further, there is also the 3:2 pull-down effect, caused by the different 
5 frame rates of the movie projector and the recorder, as well as le-sarapling, etc. This makes 
this method less than optimally suited for this purpose. 



It is an object of the invention to provide a method according to the preamble, 

10 which can embed the extra information in such a way that it can be reliably detected. 

This object is achieved in a mediod according to the invention which 
comprises assodating groups of one or more candidate frames in the input signal with 
respective portions of the extra infcxmation, and performing for each group an edit operation 
on the cme or more candidate firames of that group in dependence on its associated respective 

15 portion. When the input signal has been modified in this fashion, the modifications can later 
be easily and reli^ly detected by comparing the in(>ut signal against an original version and 
detecting the performed edit operations on the candidate frames. The extra ii^ormation 
preferably is an identifier for the theatre in which the modijBed input signal is to be shown, so 
that it can be identified later. 

20 In an embodiment the edit operatioii comprises one of deleting the candidate 

frame from the input signal, duplicating the candidate frame in the input signal, inserting a 
new ftame into the input signal before the candidate frame, and inserting a new frame into 
the input signal after the candidate frame. An advantage of this embodiment is that these edit 
operations are very easy to detect and virtually impossible to undo when only the edited input 

25 signal is available* For instance, if a candidate frame is deleted, this can be detected with a 
ample &ame*by-frame comparison, yet the creator of an unautiiorized copy cannot restore 
the candidate frame. 

Jn a fvaibeT embodiment the new frame is associated with the extra 
information. The new frame can, for example, comprise an image identifying the theatre in 

30 which the modified input signal is to be shown. This later allows easy identification of die 
theatre in which die unautiiorized copy originated. 

In afurtiier embodiment the method furtii^ comprises inserting an indicator 
for the candidate frames into the input signal. Since there is always the possibility that some 
frames weie edited due to external circumstances, for example a bad recording, it is 
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advantageous to identify which £rames aze candidate frames, so that only those fraimes axe ' 
considered in detecting die extra infoimation. By inserting this identification into the input 
signal, it can be detected later. Preferably the indicator is inserted as a watermark. 

Jn a finther embodiment Ae candidate £rames are frames that xepiresent scene 
5 changes in the input signal. An advantage of this embodiment is that these frames can be 
edited with less risk tliat the rendering will later be adversely affected. For instance, deleting 
a frame that occurs at a $c^ne boundary will, at worst, only make the scene boundary mom 
abrupt 

K is a further object of the invention to provide a system according to the 
10 preamble, which can embed the extra information in such a way that it can be reliably 
detected. 

This object is achieved in a system according to the invention which 
comprises associating means for associating groups of one or more candidate franoes in the 
input signa] with respective portions of the extra information, and editing means for 
IS performing for each group an edit operation on the one or more candidate frames of that 
group in d^hdence on its associated respective portion. 

It is a further object of the invention to provide a method according to the 
preamble, which allows easy and reliable detection of the extras information. 

' This object is adneved in a method acccxtding to the mviention which 
20 comprises cdo^ating the input dgnal widi an oiigbial input signal to obtain one xxr more 
differences between the input signal and the origbial input signal, and decoding the one or 
more di£(eiences as respective xx>rtions of the extra information. Con^aring the input signal 
with an origbial vorsian, preferably on a bameHby-frame basis, allows for easy detection of 
those frames that were edited. The nature of the eifit operations that were performed, together 
25 with the location of the edited frames, can be used to determine the poiti ons of the «tra 
information. 

It is a fmthor object of the invention to provide a system according to the 
preamble, which aDows easy and reliable detection of the extra information. 

This object is achieved in a system according to the invention which 
30 comprises comparing means for comparing the input signal with an original input signal to 
obtain one or more differences between the input signa] and the original input signal, and 
decoding means for decoding the one or more cfifFeimces as respective portions of the. extra 
information. 
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These and other aspects of the invention will be apparent from and elucidated 
with lefmnce to the embodiments shown in the drawings, in which: . 

Figure 1 schematically shows a system for embedding extra information in an 
5 input signal according to the invention; and 

Figure 2 schematically shows a system for detecting extra infonnation 
embedded in an input signal according to the invention. 

10 Throughout the figures^ same reference numerals indicate similar or 

corresponding features. Some of the features indicated in the drawings are typically 
implemented in software, and as such represent software entities, such as software modules 
or objects. 

Figure 1 schematically shows a system 100 for embedding extm infonnation 

15 in an input signal 101. The system 100 comprises associating means 102 and editing means 
103- The extra information can be anything, but preferably is an identifier of the digital 
cinema theatre in which the input signal 101 is to be presented after it has been modified. 
This identifio: can for exan^le be a sequence of bits, where each sequence uniquely 
identifies one theatre. The input signal 101 preferably is a video signal, but may also be an 

20 audio signal or some other kind of signal. The system 100 is preferably located in a Digital 
Cinema Theatre, so that the extra information can be embedded during or jujst before the 
actual projection to the audience. 

The associating means 102 associate groups of one or more candidate frames 
in the input signal 101 with respective porticms of tiie extra inframation. First, the available 

25 cancfidate firames need to be identified This identification can be done outside the system 
100, in which case the locations of the candidate firames need to be communicated to the 
associating means 102 beforehand. Alternatively, the associating means 102 may be arranged 
to detect scene changes in the input signal 101 and to identify the frames that represrat said 
scene changes as candidate frames. The associating means 102 could also simply pick one 

30 firame at regulariy spaced distances in the input signal, for instance once every one thousand 
fiames. This last alternative is very simple to implement, but may cause visual distortions in 
the input signal. 

When the candidate frames are identified, they are then grouped. Each group is 
associated with a respective portion, preferably a single bit, of the extra information. Assume 
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for instance that there are a thousand candidate frames and twenty bits of extra infdimalion to 
embed. Iheie are now sev^ ways to associate the groups with respective p<»tions. A 
sinq>le and preferred way is to form twenty groups of fifty candidate frames and to associate 
the first fifty candidate firames with the first portion, the next fifty candidate frames with the 
5 second portion, and so on, until the final fifty candidate fiMaes have been associated with flic 
twentieth portion. An alternative way is to create forty groups of twenty-five candidate 
frames, and to associate the first twenty groups and the last twenty groups separately as 
described above. This way, the extra information is embedded twice, which oiakes the 
embedding more reliable. Of course, other ways to group the candidate fiames also exist 
10 When the grouj^ have been formed, the editing means 102 perfonn for each 

group an edit operadon on the one or more candidate frames of that group in dependence on 
its associated respective portion. This edit operation should represent the infonnation in that 
portion. When the portion is a single bit, thai the edit operation can be used to represent a 
one or a zero in the candidate frames of the group. For instance, deleting the candidate frames 
IS can be used to represent a one, and not deleting the candidate fiames, the null operation, can 
be used to represent a zm). 

Other edit operations, such as duplicating flip candidate frame in the input 
:^gnal 101^ inserting a new firune into the input signal 101 before the candidate frame, and 
inserting anew'fiame into the input signal 101 after the cmdidate frame can also be used. For 
20 iTi^rtOTiTf* ^^mdidf'*? fiamfes can be delved to lepr esent a zero, and be duplicated to represent a 
one. It is not necessary to use only two edit operations, although this is preferred for reasons 
of mnplici^. The edit operation is preferably pncfoimed on all candidate ftames of the group 
in questiiMi, whi(± makes the inethod mme ibbusL 

If a new frame is to be ii^ated, it is preferably associated wifli the extra 
25 information. The new fiame can, for cxan^le, comprise an image identifymg the theatre in 
which the modified input signal 101 is to be ^own. This later allows easy identification of 
flie flieatie in which theunaufliorized copy originated. 

Since flie way in which flie candidate frames were selected and grouped may 
not be known befordiand, it can be advantageous to insert an indicator for flie candidate 
30 frames into the input agnal 101. This psefmbly is done by means of a digital watermailc, so 
that it is unobtrusive to viewers when the input signal 101 is shown. Tliis indicator can for 
instance indicate that every lOO'th frame is a candidate fi:ame. It may also be inserted on the 
candidate frames fliemselves» so that they can be identified as such by a detecting system. 
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To illustrate the method further^ consider the following example. Suppose" * 

there are 10,000 theatres in which the input signal 101 is to be shown. Each theatre can be 
assigned a unique 15 bit number^ the projector key K. Suppose further that a the input signal 
lasts 90 minutes and has one candidate frame for deletion every five seconds^ so in total tfiere 
5 are 1080 candidates. These 1080 frames can then be partitioned in 15 groups of 72 frames 
each. The editing means 103 then deletes the frames in the m-th group if and only if the m-th 
bit of K equals 1, and performs the null operation ofterwise. So» a key K=100101111111001 
would result in deleting frames 1 to 72, 217 to 288, 361 to 864, and 1009 to 1080. 

Figure 2 schematically shows a system 200 for detecting extra information 
10 embedded in an input signal 201. The system 200 comprises comparing means 202 and 

encoding means 203. The input signal 201 pr^etably has the extra information embedded as 
described above with reference to Figure L 

• Hie comparing means 202 compares the input signal 201 with an ori^nal 
input signal 204 to obtain one or more differences between the input signal 201 and the 
15 original input signal 204. This is preferably done on a frame-by-frame basis. The differences 
that are obtained can be frames thai are missing in tfie input sighal^201 but present in the 
original input signal 204» fnames that occur twice in the input signal 201 and once in the 
original input signal 204, frames that are preset in the input signal 201 but missing in the 
original input agnal 204, and so on. Hie comparing means 202 snds infodnation regarding 
20 these differences to die decoding means 203. 

The decoding means 203 decodes the CHie ormoredifiFerences as respective 
portions of the extra infomiation. It may be necessairy to read an indicator inserted into die 
input signal 201 to detennine the location of die candidate frames. Differenoes that do not 
relate to candidate frames are ignored, if they are present Since die candidate frames are 
25 grouped, the detected differences should be grouped as well. This allows the system 200 to 
cope with single-frame errors. For instance, if the edit operation was duplicating the 
candidate frames, and one such duplicate was accidentally dropped from the input stream 
201, ttien the fact that all die other candidate frames of that group are duplicated provides 
sufiBdent inf ormatim to conclude that that group was duplicated and the single missing 
30 duplicate was an error. 

The one or more diffen^ces can be decoded into portions of the extra 
information depending on their encoding mediod. For instance, if deleting the candidate 
frames was used to represent a one, and not deleting the candidate frames, the nuU opoation, 
was used to represent a zero^ then the absence of a candidate frame in the input signal 201 is 



wo 01/28230 PCT/EPOO/lOOOl 

7 

decoded into a one. If the candidate fir^e is present, iii other words if no diffeience is 
detected^ then this fact is decoded into azeio. 

Jn the example given with reference to Hgure 1, a key K was embedded by 
deleting candidate ftames 1 to 72, 217 to 288, 361 to 864, and 1009 to 1080 from the input 

5 signal 101. Using this example, the decoding means 203 receives from the coniparing means 
202 the infomialion that those ftames are missing from the input signal 201. The encoding 
method used comprised deleting a group of candidate frames to indicate a one, and not 
deleting to indicate a zero. So, the decoding means ^03 now decodes the fact that candidate 
frames 1 to 72 were deleted into a one for the first portion of the extra information, the fact 

10 that candidate frames 73 to 216 were not deleted into zeroes for the second and third 
portions, and so on. Thus, ttie original key KslOOlOlllUllOOl is obtained. 
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1. A method of embedding extra infonnation in an input signal (101), comprising 
associating groups of one or more candidate frames in fbe input signal (101 ) with respective 
portions of the extra infonnation, and perfonning for each group an edit operation on the one 
or more candidate frames of that group in dq[>endence on its associated respective ]K)rtion. 

5 

2. A coethod as claimed in claim 1, whereby the edit op^tion comprises one of 
deleting Iht candidate firame £rom the input signal (101), dupUcaring fht candidate frame in 
die input signal (101), inserting a new frame into the input signal (101) before the candidate 
frame» and inserting a new frame into the input signal (101) after the candidate frame. 

LO 

3. A method as claimed in claim 2, whereby the new frame is associated wittt the 
extra information. 

4. A method as claimed in claim l,fiu1h^c(mipriang inserting an in& 

IS die candidate frames into the input signal (101). . . . 

5. A method as claimed in claim 4, whereby the indicator is inserted as a 

watcnnaric 

20 6, A method as claimed in claim 1, wherein the candidate frames are frames tiiat 

represent scene changes in the input signal (101). 

7. A system (100) for embedding extra information in an input signal (101), 

comprising associating means (102) for associating groups of one or more candidate frames 
25 in the input signal (101) with respective portions of the extra information, and editing means 
(103) for perfonning for each group an edit operation on the one or more candidate frames of 
that group in dependence on its associated respective portion* 
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8. A method of decoding extra inforraation embedded in an input signal (20r);- 
comprising comparing the input signal (201) with an original input signal (204) to obtain one 
or more differences between the input signal (201) and the original input signal (204). and 
decoding the one or more differences as respective portions of the extra information. 

5 

9. A system (200) for decoding extra information embedded in an input signal 
(201), comprisuig comparing means (202) for comparing the input signal (201) with an 
original input signal (204) to obtain one or more differences between the input signal (201) 
and fte original input signal (204), and decoding means (203) for decoding the one or more 

10 diffemices as respective portions of the extra informaticm. 
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